Investigation on Application of Local Cluster Analysis and Part of Speech Tagging on Persian Text
نویسندگان
چکیده
In this research we applied Local Cluster Analysis (LCA) in tandem with Part-of-Speech tagging to monolingual task. We study different Persian POS tags and select a set of designated tags to reduce the size of our index and store the rich content of the documents. In addition, we applied LCA on the retrieved documents to detect the relevant and irrelevant documents to the user query. The clustering method is an important part in our approach. So we address the problem of building effective and meaningful clustering and evaluate different well-known and state of the art clustering methods for better efficiency and effectiveness in the proposed approach.
منابع مشابه
سیستم برچسب گذاری اجزای واژگانی کلام در زبان فارسی
Abstract: Part-Of-Speech (POS) tagging is essential work for many models and methods in other areas in natural language processing such as machine translation, spell checker, text-to-speech, automatic speech recognition, etc. So far, high accurate POS taggers have been created in many languages. In this paper, we focus on POS tagging in the Persian language. Because of problems in Persian POS t...
متن کاملAn improved joint model: POS tagging and dependency parsing
Dependency parsing is a way of syntactic parsing and a natural language that automatically analyzes the dependency structure of sentences, and the input for each sentence creates a dependency graph. Part-Of-Speech (POS) tagging is a prerequisite for dependency parsing. Generally, dependency parsers do the POS tagging task along with dependency parsing in a pipeline mode. Unfortunately, in pipel...
متن کاملA hidden Markov model for Persian part-of-speech tagging
One of the important actions in the processing of languages is part-of-speech tagging. Against of this importance, although numerous models have been presented in different languages but there is few works have been done in Persian language. In this paper, a part-of-speech tagging system on Persian corpus by using hidden Markov model is proposed. Achieving to this goal, the main aspects of Pers...
متن کاملA Statistical Part-of-Speech Tagger for Persian
This paper presents the statistical part-ofspeech tagger HunPoS trained on a Persian corpus. The result of the experiments shows that HunPoS provides an overall accuracy of 96.9%, which is the best result reported for Persian part-of-speech tagging.
متن کاملA Persian Part-Of-Speech Tagger Based on Morphological Analysis
This paper describes a method based on morphological analysis of words for a Persian Part-Of-Speech (POS) tagging system. This is a main part of a process for expanding a large Persian corpus called Peyekare (or Textual Corpus of Persian Language). Peykare is arranged into two parts: annotated and unannotated parts. We use the annotated part in order to create an automatic morphological analyze...
متن کامل